Minimax-optimal nonparametric regression in high dimensions
نویسندگان
چکیده
منابع مشابه
Rodeo: Sparse Nonparametric Regression in High Dimensions
We present a method for nonparametric regression that performs bandwidth selection and variable selection simultaneously. The approach is based on the technique of incrementally decreasing the bandwidth in directions where the gradient of the estimator with respect to bandwidth is large. When the unknown function satisfies a sparsity condition, our approach avoids the curse of dimensionality, a...
متن کاملNearly Optimal Minimax Estimator for High Dimensional Sparse Linear Regression
We present estimators for a well studied statistical estimation problem: the estimation for the linear regression model with soft sparsity constraints (`q constraint with 0 < q ≤ 1) in the high-dimensional setting. We first present a family of estimators, called the projected nearest neighbor estimator and show, by using results from Convex Geometry, that such estimator is within a logarithmic ...
متن کاملMinimax rates for nonparametric speci cation testing in regression models
In the context of testing the speci cation of a nonlinear parametric regression function, we study the power of speci cation tests using the minimax approach. We determine the maximum rate at which a set of smooth local alternatives can approach the parametric model while ensuring consistency of a test uniformly against any alternative in this set. We show that a smooth nonparametric testing pr...
متن کاملNonparametric Learning in High Dimensions
This thesis develops flexible and principled nonparametric learning algorithms to explore, understand, and predict high dimensional and complex datasets. Such data appear frequently in modern scientific domains and lead to numerous important applications. For example, exploring high dimensional functional magnetic resonance imaging data helps us to better understand brain functionalities; infer...
متن کاملMinimax optimal designs for nonparametric regression - a further optimality property of the uniform distribution
In the common nonparametric regression model yi g ti ti i i n with i i d noise and nonrepeatable design points ti we consider the problem of choosing an optimal design for the estimation of the regression function g A minimax approach is adopted which searches for designs minimizing the maximum of the asymptotic integrated mean squared error where the maximum is taken over an appropriately boun...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: The Annals of Statistics
سال: 2015
ISSN: 0090-5364
DOI: 10.1214/14-aos1289